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Abstract 

Through a combination of experimental techniques we show that the topmost layer of the topo¬ 
logical insulator TlBiSe 2 as prepared by cleavage is formed by irregularly shaped T1 islands at 
cryogenic temperatures and by mobile T1 atoms at room temperature. No trivial surface states are 
observed in photoemission at low temperatures, which suggests that these islands can not be re¬ 
garded as a clear surface termination. The topological surface state is, however, clearly resolved in 
photoemission experiments. This is interpreted as a direct evidence of its topological self-protection 
and shows the robust nature of the Dirac cone like surface state. Our results can also help explain 
the apparent mass acquisition in S-doped TlBiSe 2 . 

PACS numbers: 68.37.Ef, 68.37.Ps, 71.70.Ej, 73.20.At, 79.60.-i 


2 



I. INTRODUCTION 


Topological insulators (TIs) constitute a novel class of materials that has received a large 
amount of attention over recent years [1, 2 ], The main reason for this strong scientific 
interest is the presence of metallic surface states with a helical spin structure on the surface 
of a semiconducting bulk material, which renders them a possible candidate for spintronics 
applications [3]. However, spin-polarized surface states are not a unique characteristic of 
topological insulators. Spin-split states have been found on the surface of a variety of systems 
which do not belong to this class of materials, i.e., topologically trivial Rashba systems [4-6]. 
The truly unique property of the surface states of topological insulators is their so-called 
topological protection; they can not be destroyed by perturbations that do not break time 
reversal symmetry. Within a simplified model it is often suggested that this protection is 
caused by the spin structure which suppresses backscattering events as this would require 
a, highly improbable, spin flip [ 2 ]. Although this simplification is certainly valid for the 
one-dimensional edge states of two-dimensional ( 2 D) TIs [7], the additional phase-space 
available for scattering for the 2 D surface states of 3D TIs calls for a protection mechanism 
different from avoided backscattering. Indeed, scanning tunneling spectroscopy experiments 
on both topological insulators and topologically trivial materials with spin-polarized states 
reveal similar scattering rules around defects [8-10]. In recent photoemission experiments 
on the topological insulator 612803 it was found that even after mild ion sputtering the 
topological surface state was no longer visible [11]. Later theoretical considerations verified 
this behaviour and suggested that the state actually moved to the next quintuple layer [ 12 ]. 
This indicates that the real protection mechanism of the topological surface state is just 
like its unique spin structure a consequence of the transition between phases of different 
topology at the edge of a TI [1]. 

Intrinsic to the definition of topological classes is that it is impossible to go from one 
class to another through continuous deformations. As illustrated by the knots with differ¬ 
ent topology in Figure 1 (a), to go from one topological class to another the system has 
to go through a singularity. In the electronic structure of a material the topological class, 
or genus g, is defined by the number of parity inversions in the bulk band structure [13]. 
A non-trivial {g = 1) band structure has an odd number of parity inversions, whereas a 
trivial band structure (g = 0) has an even number of parity inversions. At the interface 
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between the two systems the band gap must thus close and re-open again, which leads to 
the formation of an interface state [14], Therefore at the transition between two regions of 
different topological classes an interface state must exist [1], Here we show by a combina¬ 
tion of angle-resolved photoemission (ARPES), scanning tunneling microscopy (STM), and 
atomic force microscopy (AFM) that the protection mechanism of the topological surface 
states is most likely based on moving away from regions with high defect density due to the 
fact that these regions obtain a trivial topology. 


II. EXPERIMENTAL METHODS 

Single crystals of TlBiSe 2 were grown from high purity elements using a Bridgman 
method. The bulk crystalline quality was checked using X-ray diffraction. All the sam¬ 
ples used at the different facilities and different techniques originate from the same batch of 
crystals. Oriented single crystals were glued on the respective sample holders and cleaved in 
ultrahigh-vacuum (UHV) by knocking off a top-post. All presented results are reproduced 
for a large number of cleaves and show no clear dependence on cleaving temperature. 

The photoemission experiments were performed using the spin-polarized ARPES end station 
COPHEE [15] as well as the high resolution ARPES end station at the Swiss Light Source 
using linearly (p) polarised light at a sample temperature of 20 K and a base pressure better 
than 2 • 10“^°mbar. Samples were cleaved at 20 K, 60 K and room temperature (RT). 

STM experiments were performed in an Omicron multichamber UHV system with a base 
pressure below 1 • 10“^° mbar using a home-built variable temperature STM. Both the tip, 
electrochemically etched from polycrystalline W wire, and sample were cooled by a Cryovac 
continuous flow He cryostat to T = 30 K. STM topography images were taken in constant 
current mode at a tunneling current / with the bias voltage U applied to the sample. The 
samples were cleaved at ~ 150 K and RT. 

The AFM experiments were performed with an Omicron low temperature combined STM/ 
AFM system operated in UHV at a temperature of 4.4 K. The microscope is equipped with 
a qPlus sensor [16]; again W is used as tip material. The bias voltage is applied to the 
sample. For AFM operation, the frequency modulation mode is utilized [17]. Here, the 
oscillation amplitude A (typically A = 50 pm) is kept constant and the frequency shift A/ 
of the cantilever, which is a measure of the force gradient between tip and sample, is moni- 
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FIG. 1. (a) Illustration of a topological interface by knots. The trifoil knot on the left can not be 
transformed into the unknot on the right without going through a singularity, (b) ARPES band 
map of TlBiSe 2 along the F-M direction measured at a photon energy of 20 eV. The dashed blue 
lines indicate the bulk band gap Eg. (c) Core level XPS of TlBiSe 2 obtained at normal emission 
and a photon energy of 120 eV. (d) and (e) Constant energy surfaces obtained at a photon energy 
of 20 eV and a binding energy of 280 meV corresponding to the Dirac point (d) and 100 meV (e). 
(f) and (g) Photon energy dependent scans at constant ky and a binding energy corresponding to 
the Dirac point (f) and lOmeV (g). 


tored. Samples were cleaved at RT. 

The RT STM measurements were carried out on a home-built STM/AFM system in UHV 
at a pressure of 2 • 10“^° mbar. QPlus sensors with W tips are used and the bias voltage is 
applied to the tip. Samples were again cleaved at RT. 


III. RESULTS AND DISCUSSION 

Figure 1 (b) shows ARPES data of the well established Dirac cone and a larger range 
of the valence band of the (001) surface of TlBiSe 2 [18-20]. Although this Dirac cone and 
the associated spin structure clearly establish TlBiSe 2 as a topological insulator we would 
like to draw the focus not only to the presence of this state, but also to the absence of 
any other surface states within the bulk band gap, and also at higher binding energies. 
Although density functional theory (DFT) calculations predict the presence of additional 
trivial surface states regardless of the exact surface termination [21], no ARPES experiment. 
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including ours, has been able to reproduce these states. This is in stark contrast, e.g., to 
Bi 2 Se 3 where the topological surface state is found to coexist with other surface states [22- 
26]. In order to exclude photoemission matrix element effects as the reason for the missing 
observation of trivial surface states, we also scanned along the perpendicular momentum 
direction as shown in the constant energy maps in Figure 1 (d) and (e). Furthermore we 
performed photon energy dependent measurements (Figure 1 (f) and (g)) and did not observe 
any additional surface states in the bulk band gap throughout the full energy range. As 
will be discussed below the absence of these trivial surface states and the well defined line 
shape of the topological state are indicative of the topological self-protection. The x-ray 
photoelectron spectroscopy (XPS) data in Figure 1 (c) shows the chemical purity of the 
sample and gives a first hint of the surface structure through the observed double peak of 
the T1 5d core levels, which reveals two types of environments for the T1 atoms implying 
that the surface is formed by T1 atoms [27]. 

In order to obtain a better understanding of the surface termination and to understand 
why the topologically trivial surface states could be missing in the ARPES data, we per¬ 
formed STM experiments on the same batch of samples. Figure 2 (a) shows a large scale 
topography image of a freshly cleaved sample. Several sharp step edges can be resolved 
which have two principal orientations rotated by 60° with respect to each other, indicating a 
good overall in-plane crystallinity. The corresponding histogram in Figure 2 (c) shows that 
all step heights are integer multiples of ~ 0.75 nm. This fits to the Tl-Tl distance (Figure 2 
(d)), also indicating that along the ; 2 -direction the sample shows the expected crystallinity. 
In contrast, the zoomed image in Figure 2 (b) and the inset display a structure which resem¬ 
bles a partly ordered amorphous or liquid-like structure. We refer to the regions with higher 
apparent height in the inset of Figure 2 (b) as worms. The same structure was observed 
over the complete sample surface regardless of sample and cleave, independent of cleaving 
temperature, scan parameters, and tip condition. These worms thus can be regarded as an 
intrinsic property of the cleaved TlBiSe 2 surface. In our STM measurements at different 
bias voltages we see no evidence of any dispersive electronic states within the worms, but it 
should be noted that based on these measurements alone we can not exclude the presence 
of such states. 

From our STM measurements it is not possible to determine the spatial extent of the 
worms normal to the surface, i.e. whether it is only one or several atomic layers. On 
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FIG. 2. (a) 1.5 X 1.5 /im^ constant current STM image of cleaved TlBiSe 2 . (b) Zoomed images, 
resolving a disordered structure (150 x 150 nm^, inset: 20 x 20 nm^). (c) Histogram of step height 
distribution in (a). The peaks are all spaced by multiples of the Tl-Tl distance of about 0.75 nm. 
(d) Crystal structure model of TlBiSe 2 [21]. Imaging parameters: (a,b) / = 100 pA, U — 500 mV. 

the other hand, AFM measurements are able to resolve an atomic structure even if it is 
disordered [29]. Thus, we performed simultaneous STM/AFM measurements. The STM 
image obtained from this experiment (Figure 3 (a)) closely resembles those measured with 
a dedicated STM setup shown in Figure 2 (b), further supporting the universality of these 
results. It was not possible to obtain atomically resolved images in STM or AFM feedback 
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FIG. 3. (a) Constant current STM topography data (11.9 x 11.9nm^). (b) Constant height A/ 
image of the same area as in (a). In the frequency shift image the hexagonal atomic structure 
within the worms is clearly resolved, (c) Low-pass and Laplace filtered version from (b), where 
each atomic site is marked with a cross [28]. (d) Line profile from (e); the peaks are related to 
the periodicity of the worms, (e) Fourier spectrum of (b); the outer hexagon resembles the atomic 
ordering within the worms, the inner one the long-range hexagonal order of the worms, (f) Line 
profile from (e); the two peaks at ±16.4 nm“^ are related to the periodicity of the atomic lattice. 
Imaging parameters: (a) / = 130 pA, U = 200 mV; (b) tip height A 2 ; = —230 pm with respect to 
the STM set point in (a), U = 10mV, A = 50pm, quality factor Q = 28140, stiffness k = 1800N/m 
and resonance frequency /o = 26.666 kHz. 


mode. Therefore we switched to constant height mode, while gradually decreasing the tip 
sample distance, until atomic resolution within the worm-like structure showed up in the 
frequency shift A/. In Figure 3 (b) the tip was approached by 230 pm relative to the STM 
setpoint in Figure 3 (a). Within the worms, a surprisingly large amount of local crystalline 








































order was observed. A closer inspection reveals that, although no continuous connection is 
visible, all islands show the same crystal structure and orientation. Furthermore there is 
no shift in the registry of the atoms in different islands as indicated by the dashed lines in 
Figure 3 (b). This is better visualized in the Fourier transform of the frequency shift data 
as shown in Figure 3 (e), which displays two clear hexagonal patterns. The outer one is 
due to the atomic structure and the inner one is due to the hexagonal superstructure of the 
worms. Each of the outer peaks has satellites arising from the hexagonal superstructure of 
the worms. From the distance of the Fourier peaks, corresponding to the superstructure 
(Figure 3 (d)) and the atomic structure (Figure 3 (f)), the real-space average distance 
between the worms and the atomic lattice spacing are determined. For the superstructure 
we obtain dworms = (27r)/(3.18 nm“^ -cos 30°) = 2.28 nm and for the nearest-neighbor distance 
dun = (27r)/(16.30nm“^ • cos 30°) = 445 pm, which is off by about 5% from the bulk lattice 
constant of 425 pm [30]. Note, that the direct hexagonal lattice is rotated by 30° with respect 
to the reciprocal lattice. 

Although also here the second atomic layer can not be resolved, we conclude due to the well 
defined crystal structure within the worms and the correlation between them that only the 
topmost atomic layer is damaged during the cleaving process. This is further corroborated 
by the 30° rotation of the superstructure peaks with respect to the atomically resolved 
structure in the Fourier spectrum which is expected for subsequent layers (Figure 2(d)). 
This suggests that the worms sit on a well ordered layer and all deeper layers have the 
expected crystal structure. 

A quantitative analyis of Figure 3 (b), performed by counting individual atoms, yields a 
number of 420 (Figure 3 (c)). The total number of primitive units cells of area A = y/3d‘^^/2 
which fit within the 11.9 x 11.9 nm^ scan area in Figure 3 (b) is 826, resulting in a ratio 
of 420/826 = 0.51. Apart from the atoms integrated in the islands we also observe several 
individual atoms in between. Such non-integrated atoms hint towards a composition of the 
worms of a metallic element and exclude a chalcogen such as Se. Furthermore, the lowest 
energy cleaving plane is found between the T1 and Se layers, where the distance between 
T1 and Se layers is o^Tise = 209 pm and dBiSe = 167 pm between Bi and Se layers [21], 
which suggests that the cleaving indeed occurs between T1 and Se layers. This is further 
corroborated by a recent XPS study which found a chemically different environment for the 
T1 atoms close to the surface and for those in the bulk of the crystal [27], as also shown in 
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(a) Af [Hz] (b) Af [Hz] 



FIG. 4. Atomically resolved images before (a) and after (b) a lateral manipulation process. The 
full (dashed) circles indicate occupied (unoccupied) atomic sites. The arrows mark the most likely 
manipulation path for the atoms. The different appearance of the atoms (bright in (a) and dark 
in (b)) is due to different relative tip-sample distances. In (a) the tip is about 100 pm closer to the 
surface than in (b). Imaging parameters: U = 10mV, A = 50pm, Q = 1.1 • 10®, k = 1800N/m 
and /o = 59.358 kHz. 

Figure 1 (c). Altogether we conclude that the surface is formed by T1 atoms with one half 
of the atoms remaining on the surface, while the other half is cleaved away. Due to the large 
amount of energy induced by the cleaving and the relatively weak bond between T1 and Se, 
the top atomic layer melts and then recrystallizes in the observed hexagonal superstructure 
even when the samples are cooled during the cleaving process. 

Figure 4 shows two constant height Af images of the same area. The different appearance 
of the atoms is due to different relative tip-sample distances. Most notably, the positions of 
some of the atoms, which are indicated by blue circles, have changed in between the images. 
This is due to a lateral manipulation process induced by the tip. After Figure 4 (a) was 
acquired the tip was approached closer to the surface while scanning in the upper region of 
Figure 4 (a) until the oscillation amplitude became unstable. The tip was then retracted 
in constant height and the same area was imaged again (Figure 4 (b)). A comparison of 
Figures 4 (a) and (b) allows to identify that integrated (center atom of the hexagon) as 
well as non-integrated (top left atom) atoms were manipulated laterally. This suggest that 
the potential barrier for a lateral manipulation process is quite similar for integrated and 
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non-integrated atoms and that the worms in itself are loosely bound. 

To answer the question how stable these islands are, we investigated the surface with 
STM at RT. Figure 5 (a) shows steps with a height of about 0.8 nm (Figure 5 (b)) which fits 
to the Tl-Tl distance. In contrast to our low temperature measurements we do not observe 
a worm-like structure. Instead, a regular hexagonal lattice is revealed in the atomically 
resolved images in Figures 5 (c) and (d). Apart from the hexagonal lattice one can also 
identify a triangular depression in Figure 5 (c) which we attribute to a sub-surface defect 
site similar as reported for 612803 [31, 32]. We attribute the absence of the worms at RT 
to an increased mobility of the T1 atoms which move now too fast to be imaged by our 
slow STM (bandwidth B ^ IkHz). The large number of horizontal streaks in Figures 5 
(a) and (c) and the unstable imaging conditions support this further. Additionally, this 
interpretation is corroborated by studies of T1 on Si(lll)-7 x 7 at RT where T1 atoms are 
mobile on the surface and get trapped in an attractive potential to form nanodots [33, 34]. 


IV. CONCLUSION 

In the following we discuss the possible scenarios that combine our ARPES, STM, and 
AFM observations with published calculations [ 21 ]. As mentioned above, calculations for 
all possible surface terminations show occupied topologically trivial spin-split surface states. 
Again, none of these states are observed in ARPES. The only exception is in case of a 
stacking fault at the surface resting in a -Se-Bi-Tl-Se structure instead of the expected -Se- 
Bi-Se-Tl unit. If such a stacking fault would be present it would result in a Se top layer, 
which is in direct conflict with our XPS and AEM results which indicate a T1 termination 
of the worms. Eurthermore this interpretation would lead to the conclusion that in every 
sample studied by a variety of groups, grown in different laboratories, and for every cleave, 
a stacking fault is present exactly at the surface. Therefore, although we cannot exclude 
this possibility, it appears highly unlikely. 

In Ref. [27] the authors gave a number of possible explanations for the absence of the 
trivial surface states in ARPES measurements. If dangling bond states exist but are localized 
on the small islands and in between them the contribution to photo-emitted electrons might 
be too small to be detected by ARPES. Other possible reasons are the ionic nature of 
the interlayer bonding between T1 and Se or the saturation of the dangling bonds due to 
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FIG. 5. (a) Constant current STM topography data resolving several steps with heights of « 

0.8nm, see (b). (c),(d) The atomic resolution images show a regular hexagonal lattice. In (c) a 
triangular shaped defect can be identified. The image in (d) is low-pass filtered. The distortion 
of the hexagonal lattice is due to lateral drift and creep. Imaging parameters: (a) I — 100 pA, 
U = -800 mV. (c) I = 50pA, t/ = 300 mV. (d) I = 100 pA, U = -600 mV. 

a deformation of the islands. This deformation showed up as a reduced island height in 
the STM data of Ref. [27] compared to the bulk interlayer spacing. Our STM and AFM 
measurements at room and low temperature suggest that the crystalline islands form when 
the mobile T1 atoms freeze out during the cooling procedure of the sample. The two extreme 
situations would be either a huge T1 island which covers half of the cleavage surface or a 
uniform distribution of T1 atoms occupying each second lattice site. Intuitively one might 
think that in the latter case the dangling bonds of the underlying Se layer are most effectively 
saturated by the T1 atoms on top. The nanoscale islands (Figure 3(b)) which are formed 
consist of an average number of 16 ± 6 atoms. Furthermore only about 13% of the atoms 
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have six nearest neighbors and we found no atoms with six next-nearest neighbors within 
the surface plane. This suggests that the T1 atoms first prefer to stick together but once a 
certain island size is reached it is more favorable to form a new island. This would be in line 
with the above mentioned interpretation that the particular surface termination reduces the 
number of dangling bonds. 

In an alternative, and more basic scenario, the crystallites on the surface are too small to 
allow for a Bloch-type wave to form and will thus not harbor any extended electronic states. 
Within this scenario, it is expected that any type of surface state is suppressed, which directly 
explains the absence of the spin-polarized termination-dependent topologically trivial surface 
states in the ARPES data. On the other hand, the topological surface state is clearly resolved 
in all ARPES measurements and appears not to be influenced by the surface structure. 
Lateral structures of similar dimensions result in the formation of quantum dots in the 
Cu(lll) surface state [35]. Due to the spin texture one would not expect the same simple 
quantisation mechanism for the TSS of TlBiSe 2 as not all scattering vectors are allowed. 
However, if the TSS were to have a significant probability density in the worms one would 
expect an influence on the measured spectra either in the form of broadening or quantisation 
effects. The absence of such effects in our or other published data, combined with the absence 
of the trivial surface states provides the first direct spectroscopic evidence for the topological 
protection of surface states on 3D topological insulators. This protection is not a consequence 
of the spin structure as the spin-polarized trivial surface states are destroyed, but follows 
directly from the transition from a topologically non-trivial to a trivial material [1]. Because 
the top atomic layer can not form a well defined band structure this means by definition 
that it becomes topologically trivial. Therefore the topological transition occurs one layer or 
one stack deeper and the topological interface state is located there, while extending several 
unit cells into the bulk. This is very similar to how edge states move around defects in the 
quantum Hall effect. 

A similar protection mechanism was used to explain the observed surface state band 
structure of PbBRTey, but only indirect evidence could be provided there [36]. Furthermore, 
our results can help resolve the issue of whether mass acquisition and a small gap can occur 
at the Dirac point for sulfur doped (TlBiSe 2 -xSa,) samples [20, 37]. Depending on the exact 
S concentration at the cleaving plane, the surface structure will differ and can in some case 
invoke extra scattering channels for small k-values. This is in line with the observation that 
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whether a gap is found to occur varies from cleave to cleave [37]. 

To conclude, through a combination of experimental techniques we have shown that only 
the topmost atomic layer of the topological insulator TlBiSe 2 is destroyed by the cleaving 
process. The crystalline T1 worms are too small to form a band structure and this layer 
therefore has a trivial topology. The interface between trivial and non-trivial band structure 
topology thus shifts towards the bulk and the topologically protected interface state forms 
here. This provides a direct explanation why the predicted trivial surface states are not 
observed with ARPES, but the spin-polarized topological interface state is. Consequently, 
the deliberate destruction of the surface can be a good method to suppress the occurrence of 
trivial surface states which could interfere with the desired topological transport properties. 
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